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Abstract 

We study some dynamical aspects of the action of automorphisms in model theory 
in particular in the presence of invariant measures. We give some characterizations for 
NIP theories in terms of dynamics of automorphisms and invariant measures for example 
in terms of compact systems, entropy and measure algebras. Moreover, we study the 
concept of symbolic representation for models. Amongst the results, we give some char¬ 
acterizations for dividing lines and combinatorial configurations such as independence 
property, order property and strictly order property in terms of symbolic representations. 
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1 Introduction 

In his project for classification of first order theories, Shelah introduced several dividing lines 
in theories on the base of some combinatorial complexities. The machinery developed by him 
and others is called stability theory and nowadays its modern version, neo-stability, is used 
for analyzing classes beyond class of stable theories such as NIP theories. The class of NIP 
theories which are theories that no formula has independence property, is an important class 
containing stable theories and many studies in recent years were related to it. 

On the other hand, many aspects of connection between definable groups (mostly in NIP 
context) with notions such as measure and forking are studied in for example [3] and [1]. Also 
measures as technical tools were used in [5] for the first time in stability theory. Let G be a 
definable group acting on the topological space Sg{M), space of types in G with parameters 
from model M. This action gives a flow and some of its model theoretic and dynamical 
aspects are studied in [7]. In that paper some definitions, notions and methodologies from 
topological dynamic are interpreted in the setting of model theory. Among them one can 
mention the notions of almost periodic types and Ellis semigroups. 

In this paper we make some connections between some notions from dynamical systems 
in particular ergodic theory and symbolic dynamics to model theory. For example compact 
dynamical systems, entropy and symbolic representations are notions from ergodic theory 
and symbolic dynamics which are interacting with model theoretic notions in this paper. We 
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introduce some dynamical invariants and associate them to model theoretic objects (formulas, 
definable, models and theories, etc). Then we study certain model theoretic properties (for 
example stability theoretic properties) in terms of such associated notions. 

One may equip a model or space of types with automorphism acting on them and also 
with invariant measure. Note that in the case of definable groups one may consider the 
action of the group on space of types. This structures forms some dynamical objects and 
one can study the model theoretic complexities such as stability configurations in terms of 
dynamical properties of such systems. We give several characterizations of NIP property 
in terms of dynamical and topological objects such as the measure algebras associated to 
models, abstract dynamical systems associated to the models when they are equipped with 
an automorphism and an invariant measure and also entropy. Among other invariants, we 
define and develop the concept of symbolic representation. In this case subflows of Bernoulli 
flow are associated structures. 

Now we explain about the notion of symbolic representation. It is a general philosophy 
in dynamical systems in particular symbolic dynamics that one associates some dynamical 
objects such as sub flows of Bernoulli flow B (namely 2^ equipped with the shift transfor¬ 
mation) to general complicated dynamical systems. The goal is to study the properties of 
initial system via studying the properties of simpler associated ones. This method was suc¬ 
cessfully used in several parts of dynamical system theory such as studying certain chaotic 
systems like horseshoe map by Smale. Note that finding suitable symbolic representations 
of dynamical systems is a usual trends in dynamical systems. In some part of this paper we 
more or less follow this general philosophy and associate some subflows of Bernoulli flows 
to model theoretic notions. As an example, for some instance 17 of a formula (p{x,y), an 
automorphism a and a ^ M one may consider the subflows of B generated by sets of the 
form '■= ■ c’'”'(fl) € U}. We call sets of the form ^^.[/(a) the symbolic image with 

respect to a and U. Note that when one deals with the action of a single element of the 
acting group, then one can identify the orbit of a non periodic elements with Z and see the 
symbolic image as a subset of 2^. Note that 2^ is called the Cantor space. We use this name 
also for 2^. We call functions such as ^a-,u the symbolic representation functions. So symbolic 
representations associate sub flows of B. Studying NIP theories using the properties of such 
subflows is among interests. Also characterization of other combinatorial configurations such 
as order property strictly order property is also under consideration. 

Organization of the paper is as follows. In section [2] we review some preliminaries. In 
section [3] we study NIP in terms of dynamic of action of automorphisms and invariant mea¬ 
sures, in terms of entropy and also in terms of measure algebras. We give some constructions 
for measures with certain properties and use them to give some characterizations for NIP 
properties in terms of compact dynamical systems and entropy. Also we study NIP theories 
from the point of view of measure algebras of models equipped with measures. In section 0] 
we define the concept of symbolic representation for models and characterize NIP property, 
order property and strictly order property in terms of the notion of symbolic image. We also 
use these characterizations to obtain a theorem of Shelah which is connecting these notions 
together. 

2 Preliminaries and notations 

In this section we review some definitions and facts which we need in the following sections. 
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Definition 2.1 Let 6 be a natural number. A real number is called normal in base b if its 
sequence of digits in base b is distributed uniformly where by distributed uniformly we mean 
that every single digits has the same density of appearance 1/5, every tuple of digits has the 
same density of appearance 1/5^, etc. Also for the case 5 = 2 and for every p G (0, 1), we 
call a real number p-normal (in base 2) if in its sequence of digits (in base 2), the density of 
appearance of any finite binary sequence I of length n is equal to p*(l — p) where t is 
the number of appearance of 1 in I. 

Remark 2.2 For every p € (0,1), the existence of p-normal numbers is proven in 

By a Z-sequence we mean a sequence with indexes from Z. In the following definition we 
associate a Z-sequence to every non negative real number. 

Definition 2.3 For every non negative real number u represented in the binary representa¬ 
tion we define the 'L-sequence associated to n to be a binary Z-sequence lu with I{i) = 1 if 
and only if |i|’th digit of u is one for every i G Z. Note that one can see any binary Z-sequence 
as a subset of Z. 

Definition 2.4 An abstract dynamical system consists of a measure space {X, A, p) equipped 
with a measure preserving map a ■. X ^ X. A topological dynamical system, is a topolog¬ 
ical space, together with a continuous transformation, or more generally, a semigroup of 
continuous transformations of that space. 

Proposition 2.5 Let X be a compact topological space and a : X ^ X a homeomorphism. 
Then there exist a a-invariant probability measure p on Borel sigma-algebra of X. 

Now we review some notions from model theory in particular stability theory. 

Definition 2.6 Let (f{x, y) be a formula. We say that (p has order property (OP) if there 
exists some model M such that for every n G N, there exist ai,... ,an (with same arity of x) 
and bi,... ,bn (with same arity of y) such that (j){ai, bj) ^ i ^ j. 

Lemma 2.7 Let T be a theory. Then the followings are equivalent. 

1. The formula (l){x,y) has OP. 

2. Let L be an arbitrary linear order. Then there exists some model M of T and {a* : i G /} 
and {5j : i G /} sequences in M such that (p{ai, bj) 4^ i ^ j. 

3. Same as d with additional property that {a* : i G /} is an indiscernible sequence. 

Definition 2.8 Let 4>{x, y) be a formula. We say that </> has independence property (IP) if 
there exists some model M such that for every n G N, there exist ai, ..., (with same arity 
of x) such that witnesses IP of length n i.e for every J C {1,. .. ,n}, there exists some 5j 
(with same arity of y) such that 4){ai, bj) 44- i ^ J. 

Lemma 2.9 Let T he a theory. Then the followings are equivalent. 

1. The formula 4>{x,y) has IP. 
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2. Let I be an arbitrary linear order. Then there exists some model M of T and sequences 
{ai : i € 1} in M such that witnesses IP i.e for every J T I^ there exists some bj (with 
same arity as y) such that 4>{ai, bj) 4^ i € J. 

3. Same as d with additional property that {a* : i £ 1} is an indiscernible sequence. 

Definition 2.10 Let 4>{x,y) be a formula. We say that </> has strict order property (SOP) 
if there exists some model M and a sequence of |?/|-tuples in M such that bi) ^ 

(p{M,bi+i) for every i < ui. If (j){x,y) doesn’t have SOP we call it NSOP. A theory is called 
a NSOP theory if every formula is NSOP. 

Lemma 2.11 Let T be a theory. Then the followings are equivalent. 

1. The formula 4>{x,y) has SOP. 

2. Let I be an arbitrary linear order. Then there exists some model M of T and sequences 
{bi : i £ 1} in M such that (/>(M, bi) ^ 4>{M, 6i+i) for every i £ I. 

3. Same as [2] with additional condition that : i € /} is an indiscernible sequence. 
Average types 

The notion of ’’average type” in NIP theories has many application. One can see [9] for 
some of them. We define the average type of a countable sequence. 

Definition 2.12 Let I = {oi : i < w} be an indiscernible sequence and let i? be a subset 
of model. We define the average type of I over parameter set B, Av{I,B) as the set of all 
formula (f){x,b) with b £ B such that {i : —'(j){ai,b)} is finite. 

Note that under NIP assumption one has that Av{I,A) £ S{A). 

Measures and NIP theories 

A (Keisler) measure on M over parameter set A is a finitely additive probability measure 
on DefAiM), the definable sets of M over parameter set A. 

Remark 2.13 The following is shown in [5]. Any Keisler measure on M over parameter set 
A can be uniquely extended to a countably additive measure on the sigma-algebra generated 
by the Def{A) on M (by Caratheodorys theorem). Also a Keisler measure on M over 
parameter set A could be seen as a regular Borel probability measure on the space of types 
5(A). 

The following result of Keisler from [5] links Keisler measures and the notion NIP. 
Theorem 2.14 For a theory T the following are equivalent: 

1. The theory T has NIP. 

2. For every Keisler measure p. on M and every formula (f){x,y), there is no infinite set of 
instances 4>{x,ai) such that the symmetric difference of the 4>{x,ai)’s are bounded away 
from zero. 

3. Same as d but with word ’finite ’ replaced by ’uncountable ’. 

4 . Every Keisler measure on M has a countably generated measure algebra. 
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3 Dynamical system on models and spaces of types 


In this section we study some dynamical aspects of models and spaces of types when they 
are equipped with measures and automorphism. We first develop some tools for this. Let 
M be a model and a G Aut{M). A subset A C M is called ci-closed if a'^{A) C A for every 
n G Z. We let A = Obviously A is closed under action of A and if the set A is 

small (I^LI < \M\) then A is small too. 

Remark 3.1 Let M be a model, a G Aut{M) and ^ C M be ci-closed. Then a is measurable 
with respect to the Borel sigma-algebra generated by Def{A). 

Let M he, a, model, a G Aut{M) and A C M he u-closed. Then a can be seen an 
homeomorphism acting on space of types S{A) where is a compact Hausdorff space 

with logic topology r. Hence {S{A),T,a) is a topological dynamical system. Moreover for 
every a invariant measure ^ one can see ^ as a Borel probability measure on S{M) (by 
Remark l2.13p and so {S{M), a) is a abstract dynamical system. Note that the existence 
of cr-invariant measures on S{A) is guaranteed by Proposition 12.51 

Now we talk about a method for constructing measures with specific properties. We will 
use it later in the following sections. Let J- be an ultrafilter extending Frechet filter on P(N). 
We use the notation lim“^ for the notion of limit of sequences with respect to the ultrafilter 
T. More precisely for every real sequence (a*), lim'^(aj) is the unique element c such that for 
every e > 0 we have that {i ■. \c — ai\ < e} ^ F. Note that since F is extending Frechet filter, 
for any convergent sequence J = (a*) in M, lim(J) and lim‘^(J) will be the same. 

Definition 3.2 For every I C Z define dns{I) := lim„_j.oo provided that limit exists. 

Let F be an ultrafilter extending Frechet filter on P(N). Define dnsj^{I) := lim;^_j,go 
where by lim^_^j^ we mean the limit with respect to the ultrafilter F. 

Definition 3.3 Let I be a Z-sequence and VF be a finite sequence. We define (VF, I) := {i : 
VF(j) = I{i + j) for all j = 1,, \W\}. So dnsj^{{W, /)) roughly speaking is the density of 
appearance of W in /. 

Remark 3.4 Let I and W be as Definition \3.3l Then we have that 

n ={w,i). 

IsSKlVFI 

Definition 3.5 Let X be a set, B C X, a ^ X and a : X ^ X he a map. We define 
f,a,B{a) := {i G Z : F{a) G B}. 

Definition 3.6 Let F be an ultrafilter on P(N), a = (oj : i G Z) be a sequence in X and B 
be a Boolean algebra of subsets of X. We define a function on B in the following way. 
For each R G B let fJ,'^{B) = dnsj^{{i : ai G B}). In particular (at : i £ Z) can be the orbit 
of some a £ X under iteration of some map a from X to itself. So for each R G B we have 
fj.'^{B) = dnsjr{f,cr,B{o)). In this case we use the notation instead of We call and 
the limit frequency measures on B with respect to the sequence a. 

Note that defined above is a finitely additive measure on B and is cr-invariant. 
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Remark 3.7 Let M be a saturated enough model. Then the average types (defined in l2.12p 
are special cases of limit frequency measures. 

Proof Let I = be an indiscernible sequence over A C M. By saturation, there exists 

some automorphism a E Aut{M/A) and a G M such that I is some part of cr-orbit of a. Let 
T" be an extension of Frechet filter to an ultrafilter. Now consider on B = Def{M). 
Then the set of those definables D with = 1 are those containing co-finite part of I 

and therefore belong to Au(I, ^). □ 

3.1 NIP theories 

In this subsection we study effects of the property NIP on topological space and dynamical 
systems which we associate to models. 

3.1.1 NIP and compact abstract dynamical systems 

In this section we will characterize NIP theories in terms of compact (almost periodic) dy¬ 
namical systems in ergodic theory. 

Definition 3.8 We say that the abstract dynamical system {X, A, a) is a compact system 
(almost periodic system) if for every e > 0 and A G A, there exists some n E N such that 
^{a^{A)l\A) < e. 

Note that compact or almost periodic dynamical systems are closest ones to periodic systems 
in the hierarchy of dynamical systems. 

Definition 3.9 A subset I C Z is called e-wide if for every n E Z we have that 

dns{I) — dns{I H In) ^ e 
where In is obtained from / by n shifts. 

Remark 3.10 Let tt be a normal real number (in base 2) and lu be the Z-sequence associated 
to u (defined in Definition 12.3p . Then is e-wide for e = |. 

Definition 3.11 Let (f>{x,y) be a formula. 

1. 4>{x,y) is called strong wide in a model M of a theory T if there exist a G M, c G M , 
a G Aut{M) and e > 0 such that ^a,uio-) is a e-wide subset of Z where U = (j){x, c). A 
theory T is called strong wide if there exists some formula 4){x, y) such that is strong 
wide in some model of T. 

2. <p(x,y) is called weak wide in a model M of a theory T if there exist two sequences 
{an)nez G AI, {cn)nez € AI^ and some e > 0 such that letting Un = {di '■ (^{ai^Cn)} for 
each n G "Z, we have that = {ai+n '■ di G Uq} for each n G Z and {i : di G Uq} is a 
e-wide subset of Z. A theory T is called weak wide if there exists some formula 4>{x, y) 
such that is weak wide in some model of T. 
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The following statement gives a characterization of the NIP in terms of compact dynamical 
systems. In the following theorem we consider our measures to be countably additive. Note 
that by Remark 12.131 a measure on Def{M) can be extended to a countably additive Borel 
measure on the sigma-algebra generated by Def{M). 

Theorem 3.12 Let M be a saturated model of theory T. Then the followings are equivalent: 

1. T has IP. 

2. There is some nontrivial automorphism a of M, some ACM and some a-invariant 
measure pL such that {M, A, cr) is not a compact dynamical system where A is the 
sigma-algebra generated by Def{A). 

3. Same as d except that the measure p, is a global measure. 

4 . T is weak wide. 

5. T is strong wide. 

Proof (fT]=> r5|) Assume that T has IP. Then by a theorem of Shelah (see for example Theorem 
12.18 of [8]), there exists some formula (f){x,y) which witnesses IP with |x| = 1. Assume that 
lyl = t. By part[3]of the Lemma [2.91 there exists an indiscernible sequence {oj : i € Z} (where 
afs are of arrity 1) and a sequence {a* : i G Z} witnessing IP for (j). Since M is saturated 
and {oi : i G Z} are indiscernible, there exists some a € M and some a G Aut{M) such that 
IT*(a) = Ui for every i G Z. Now using Remark 13.101 we find some arbitrary e-wide subset of 
Z, say I. Since cf has IP property and M is saturated, there exists some c G M* such that 
4>{ai,c) ^ i € I. So Ccr,Lf(“) = d where U = 4>{M,c). Hence M is strong wide. Therefore T 
is strong wide. 

([5] =Hl3]) Assume that M is a model of T which is strong wide witnesses by a formula 
4>{x, y), a G M, c G M*, e > 0 and automorphism a. So is a e-wide subset of Z where 

U = (f){M,c). Let J- be an ultrafilter extending Frechet filter over N and let be the 
corresponding limit frequency measure defined in the Definition 13.61 on A, the sigma-algebra 
generated by Def{M). We use notation p instead of Clearly p is u-invariant. Now we 
show that {M,A,p,a) is not a compact dynamical system. For every n G Z, let Un = a^{U), 
I = f.a,u{<d) and J = f,cT,unUn{o.)- We have p{U) = p{Un) and J = I Ci In- So we have that 

p{UAUn) = p{U \ Un) + p{Un \U) = 2p{U) — 2p{U n Un) = 2dnsjr{I) — 2dnsj^{,J) ^ 2e. 

Therefore (M, A, p, a) is not a compact dynamical system. 

(f3l= T^ and (f5]= TT)l are Obvious. 

(f2]^ rT]l We prove by contradiction. Assume that T is NIP. Let B = 4>(M,b) be an arbi¬ 
trary instance of a formula and let e > 0 be arbitrary. Note that for every n we have a'^{B) = 
4>{M, a"-{b)). By using Theorem l2.14l we find W such that Vm >n> N^, p{a'^{B)Aa"^{B)) < 
e. Since p is u-invariant, we have p{BAa'^~'^{B)) = p{a'^(B)Aa'^(B)) < e. Since the mea¬ 
sures of definable sets determines measures of all measurable’s, then a is almost periodic and 
makes the system a compact dynamical system which is a contradiction. 

One can use the Proposition 13.201 to give another proof by contradiction for this part. 
Assume that cf has NIP. Hence for every measure, the corresponding measure algebra M 
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is precompact. Moreover a induces an isometry on Jv[. We denote the element of M cor¬ 
responding to by bi- Also denote the metric on A4 obtained from /j by Since 

A4 is precompact the sequence bi has a Cauchy subsequence. Thus the are m, n such that 
dfj,(bn,bm) < €. Hence 

= d^{bo,b^-n) = d^{bn,bm) < e. 

This shows that system is a compact dynamical system which is a contradiction. 

(jH =4 m) Assume that M is a model of T which is weak wide witnesses by a formula 
4>{x,y), e > 0 and sequences an G M, Cn G M*. Recall that Un = {at : </>(ai,Cn)} for every n. 
Also Uq is e-wide and Un = {oj-i-n : G Uq} for each n G Z. Let /„ = {A Oj G ?7„}. Clearly 
In can be obtained from Iq by n shifts. Also let a denotes the sequence (aj)z and let F be 
a ultrafilter extending the Frechet filter over N and let /r := fj!^ be limit frequency measure 
defined in the Definition 13.61 with respect to the sequence a. Let Dn ■= 4>{M,Cn) for every n. 
One can see that for every m,n we have that y{Dn) = /i(Dm). So we have that 

ll{Dn A Dm) = ll{Dn \ Dm) + n{Dm \ Dn) = 2;U(D„) - 2lJ.{Dn C Dm) 

= 2dnsjr{In) - 2dnsjr{In n Im) ^ 2e. 

Now using the theorem 12.141 cf) has IP. Note that we have used the facts that dnsjr{In) = 
dnsjr{lm) and dnsjr{ln C Im) = dnSjr{Io n Im-n)- □ 

Example Let M be a model of the theory of random graphs. By quantifier elimination 
every definable in M could be seen as disjunctions of formulas of the form 

D = R{x, oi) A ... A R{x, an) A ->R{x, 6i)... A -iR{x, bm) 

for elements Uj’s and bj's in M. We denote by Def{M) the set of all definable’s in M. 
A Bernoulli measure with parameter p G (0,1) on Def{M) is defined with the following 
valuation for every D. 

piD)=p^{l-p)^. 

One sees that p, is an Aut(M)-invariant measure on M. Also it is not hard to see that for any 
a G Aut{M), (M, Def{M),p, a) forms a non-compact dynamical system and so theorem l3.12l 
verifies existence of IP in the theory of random graphs. Note that in here we use the notion 
of dynamical system on a finitely additive measure in a similar way of countably additive 
ones. 

3.1.2 NIP and entropy 

In this part we give a characterization of NIP in terms of measure theoretic entropy of 
automorphism of models. Roughly speaking we show that NIP is equivalent to entropy zero 
on every automorphisms. We first briefly review some notions of measure theoretic entropy. 
For a more extensive description one can see for example [T]. 

Let (M, A, p) be a measure space and <7 be a measurable map on M such that p is 
cj-invariant. For every measurable partition P = {Pi,...,P„} we define the measure the¬ 
oretic entropy of P with respect to a and p with h{a,P) = linin^cx) ^II{\/^~q a~^{P)) 
where ^~^{P)) = Z^Pilogp* where piS are the measures of atoms of the partition 

a~'^{P). Now entropy of a is defined as h{a) = supp h{a, P). 

We will need the following lemmas later. 
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Lemma 3.13 Let P be a partition with k atoms. Then we have that H{P) ^ log A:. 

Lemma 3.14 Assume that X is a set (possibly equipped with additional structures), a is an 
automorphism of X and A C 'P(X). Also let A be the sigma algebra generated by A and let 
pL be a a-invariant measure on A. Assume that for every finite partition P of elements of A 
we have that h{a,P) = 0. Then we have that h{a) = 0. 

Proof Let Ll be the set of all countable ordinals. We have that A = Uqgh where for limit 
ordinals a we define £a '■= U/ 3 <o successor ordinal a = /3 + 1 we define £a to be 

the collection of sets of the form of countable unions of elements of £0 or complements of 
such. By a transfinite induction on and also a using the continuity of entropy function on 
space of partitions (see for example fact 1.7.9 of m) the proof will be obtained. □ 

By using the Remark 12.131 in the following theorem by a measure we mean the unique 
countably additive extension to {Def{M)) (the sigma-algebra generated by Def{M)) of the 
measure on Def{M) . 

Theorem 3.15 Let M be a saturated model of the theory T. Then T is NIP if and only if for 
every a € Aut(M) and every a-invariant measure pL on {Def{M)), we have that h^{a) = 0. 

Proof (=^) By using [3441 it is enough to show that every partition of definable sets have zero 
entropy. We first show that NIP implies a.z.e (i.e entropy of every a G Aut(M) w.r.t every 
cr-invariant measure is zero). Let P = {f>i(x,ai),... ,(fr(x,ar)} be a definable partition of 
M. We show that h{a, P) = 0. We have that 


^ n—1 

h{a,P) = lim —H{\/ a~^{P)). 

n—>-oo Tt V 

2 = 0 

But Vr=^o^ is exactly same as S^{A) where A = {cpi,... ,(j)r} and 

4 = {ai,..., ar,a~^{ai),a~^{ar),a~'^{ai),a~'^{ar)}. 

Using a facts about NIP theories there exists some constant real t such that S'a(4) ^ |4|h 
So using Lemma 13.131 for every n we have that 

n—1 

H{ V a-\P)) ^ log\A( = t.log{r{n + 1)). 

i=0 


Hence 


h{a,P) ^ lim — .t.log{r{n1)) = 0 

n—yoo Ti 


and the proof is complete. 


(<^=) We prove by contradiction that entropy zero for all automorphisms with respect to 
invariant measures implies NIP. So assume that T has IP. Similar to the proof of part ([T] =T5l) 
of the Theorem 13.121 we can find a formula 4>{x,y) (|x| = 1 and \y\ = t) witnessing IP in M 
by a sequence 0{a) = {on} where = o’"(a) for each n G Z where a is an automorphism of 
M. Also we let I C 0(a) be the |-wide subset of Z obtained from a normal number by the 
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method explained in Remark 13.101 and c G M* be such that (i){an, c) 4^ n G I. Using the same 
method of proof of part (|5]^ r3|l of the same theorem, we construct a limit frequency measure 
/r obtained from 0{a),a and I. We claim that has positive entropy. For that we 

prove that the measurable partition P = {Pqj.Pi} has positive entropy, where Pi = 
and Pq = Pf = -<(l){M,c). Note that /r(Po) = ^(Pi) = dns{I) = For each n, the partition 
cr~'‘{P) consists of sets of the form o-~'^{Pvi) for v = {vi,.. . ,Vn-i) G {0, 

But since I was corresponding to a normal number, for every v = (ui,..., u„_i) G {0,1}"’“^ 
we have that 

n—1 n—1 ^ 

M( n = dns( f| (/”■ - i)) = ^ 

where = I and is obtained by replacing 0 and 1 in / and also by — i we mean i times 
shift of P‘. So we have that 


n-l 

H{\/ a-HP))^-2’'.-.lcgi-). 

i=0 

Therefore h{a, P) = 1 which is a contradiction. Now the proof is complete. □ 

Now we want to give an analogue of Theorem [3T5] for definable groups in which the action 
of automorphisms are replaces by action of group. 


Remark 3.16 Let G be a definable group in a model M of a NIP theory. Also let /r be an 
invariant measure on G. Then the entropy of action of every element of G (by translation) 
with respect to // is zero. 

Proof Let r be action of s' G G on G by translation (i.e t{U) = g.U for every definable U). 
Let U = {4>f {x,ai),... ,4>^ (x, a,.)} be a dehnable partition of G where a* G M. Now rewrite 
the proof of I3.15l ii just by replacing a with r. □ 

Now we look at to an example of a basic and fundamental object in dynamical systems 
from a model theoretic point of view. 

Example The group T = (P^, +) is a dehnable group in 0-minimal structure (M, +, .,0,1) 
which it’s theory is NIP. the action of every element of T on T by group operation, gives us 
a rotation on T. Dynamic of homeomorphism of T are studied extensively and completely 
characterized by Poincare. It is also known in that entropy of rotations on T is zero. 


3.1.3 NIP and Measure algebra 

We state the following fact and use it for describing some topological properties of associated 
measure algebras to models of NIP theories. We will need the following lemma later. 

Lemma 3.17 Let (X,d) be a metric space with the property that for each sequence {oj} of 
elements of X, the set of values {d{ai,aj) ■ i ^ j} is not bounded away from zero. Then 
every sequence in X has a Cauchy subsequence. 

Definition 3.18 Let A = {X,P,g) and F = {Y,Q,v) be two probability spaces. 
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1. By an isomorphism between A and T we mean an invertible map f : X ^ Y such 
that / and f~^ are measurable and measure preserving. In that case,, we call A and 
r isomorphic. Also we call A and T isomorphic mod 0 (or point isomorphic) if there 
exist null sets Xi CL X and Yi CY such that the probability spaces X\Xi and ^ \ li 
are isomorphic. 

2. The probability space {X, X, p) is called standard (or Lebesgue spaces) if it is isomorphic 
mod 0 either to an interval with Lebesgue measure, or a finite or countable set of atoms, 
or a combination (disjoint union) of both. 

3. By a set isomorphism between A and T we mean a measure preserving isomorphism 
between their measure algebras. If such map exists we call A and T set isomorphic. 

The theory of standard probability spaces (or Lebesgue spaces) was initiated by von Neumann 
and developed by Rokhlin. We denote the measure algebra of equivalence classes of Lebesgue 
measurable subsets of the interval [0,1] with H. The following important statement (which 
is usually called ’’the isomorphism theorem”) classifies the measure algebras in terms of set 
isomorphism. 

Fact 3.19 A probability space is set isomorphic to the unit interval if and only if it is sepa¬ 
rable and non atomic, (see Theorem 1 in 

The following statement is a characterization of NIP in terms of measure algebras corre¬ 
sponding to models. We show the connection between NIP theories and standard probability 
spaces. 

Proposition 3.20 The followings are equivalent. 

1. The theory T has NIP. 

2. For every model M and every measure p on Def{M), the measure algebra corresponding 
to {M, Def{M), p) is a precompact topological space. 

3. For every model M, every A CL M and every non-atomic measure p on A, the sigma- 
algebra generated by Def{A), the measure space {M,A,p) is set isomorphic to some 
Lebesgue space (equivalently set isomorphic to the unit interval). 

Proof By using Theorem 12.141 and Lemma [3.171 

(fn Assume that T has NIP and ^ is a measure on Def{A) on model M. By part 
|4] of the Theorem 12.141 the measure algebra corresponding to p is countably generated and 
therefore is separable. Now by using of the Fact 13.191 it is set isomorphic to a Lebesgue 
space. 

([3]=i{T]) Let p be an arbitrary measure on Def{A). If p is non-atomic then by assumption 
(M, A, p) is set isomorphic to some (any) Lebesgue space. So its measure algebra A4 is 
isomorphic to measure algebra of a Lebesgue space, say unit interval. Therefore A4 has a 
countable generator. If p has nontrivial atomic and non-atomic parts, one can ignore the 
measure of the atomic part, then normalize the non-atomic part and use the above argument 
to show that measure algebra is countably generated. Completely atomic measures also 
obviously have countably generated measure algebras. Now by using part 0] of Theorem 12.141 
the theory T has NIP. □ 
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4 A symbolic dynamical view to NIP theories 


In this section we give characterizations for some stability theoretic classes such as stable, 
NIP and NSOP in terms of symbolic representation of single automorphisms. We also obtain 
a theorem of Shelah using these characterizations. Symbolic dynamic has several application 
in analyzing dynamical systems in ergodic theory, topological dynamic and even algebraic 
dynamics. As an example, in algebraic dynamical systems one usually deals with some / 
from an algebraic variety / to itself. In this situation one works with the orbit of the points, 
namely {/"'(a),n € N} for every point a of the variety. Also an important notion is the the 
notion of return sets of a point a corresponding a set Y, namely {n € Z, f"'{a) € y}. Using 
the Definition 13.51 one sees that this notion is exactly same as ^/,y(a). 

Now we review some notions from dynamical systems. Let B = (2^,s) be the compact 
topological dynamic consists of the space of all binary Z-sequences equipped with product 
topology on which operator shift s is acting. This system is called Bernoulli system. For 
every finite binary sequence I, by [I] we mean the set of those J € 2^ containing I in 
its initial segment, more precisely J{i) = I{i) for every i = 1,..., |/|. We call [/] a basic 
open set in 2^. The family of basic open sets for a basis for the topology. Note that 
topology of this system is metrizable and coming from the metric d{{ai)i^z, {h)iez) = ^ 
where t = min{|z| : ai ^ bi,i Z}. Also note that d is an ultrametric (i.e for every x,y,z 
we have that d{x, y) ^ max{d(x, z), d{y, 2 ;)}). It is also a non Archimedean metric space and 
for each ball every point is a center. Bernoulli system is an important example in symbolic 
dynamical systems and its dynamic is chaotic. For every 0 < p < 1, by a p-Bernoulli measure 
on B we mean the unique measure denoted by n such that for every finite binary sequence 
/, we have p([L]) = where rj and sj denote the number of I’s and O’s appearing 

in I respectively. One can see that p-Bernoulli measures are shift invariant on B. 

Some notations 

We set some notations. Let cj) he a formula. We use and cj)^ for the negation of (f> and 
4> respectively. Also let ^{x,y) := 4’{y,x). We denote by 10 the Z-sequence I with I{i) = 1 
for every i ^ 0 and I{i) = 0 for every i > 0. Similarly, Ol is defined in the converse way. In 
fact we can identify 10 and 01 with non positive and non negative parts of Z respectively. By 
(10)^ we mean finite part of 01 from —n’th to n’th coordinates. (Ol)^ is also defined similarly. 
We say that a binary sequence is universal if it contains every finite binary sequence as a 
subsequence. Note that in this paper we frequently identify subsets of N and Z with binary 
N-sequences and Z-sequences respectively. 

Assume that I is an infinite binary sequence and a a 1 j. By / + a we mean the sequence 
obtained from I after a shifts. If / is a finite sequence then I' = I + a is same as I but 
starts from a -|- 1 (more precisely it can be seen as I' : [a + 1,... , a -|- |/|] —>■ {0,1} with 
I'{i) = I{i — a) for every i € [a -|- 1,..., a + |L|]). Also for any binary sequence I, by we 
mean the sequence obtained by replacing 1 and 0 in / to each other. Let {la : a G D} be a 
family of binary Z-sequences. By Hago we mean a binary Z-sequence J where for every 
i we have J{i) = 1 if and only if Ja(i) = 1 for every a € D. 

Let M be a model and a G M"" for some n. We define Wa{A) to be the set of auoto- 
morphisms u of M with the property that u-orbit of a is an A-indiscernible sequence. When 
A = 0, we denote it by Wa- For an automorphism a by fi-orbit of an element d we mean the 
set Oa{a) = {a^{a) : n G Z}. 


12 


Some operations on B 

Let I, J be two elements of B. We say that / is a switching of J if / is obtained from J 
by replacing some 01 to 10 or replacing some 10 to 01 in J. Obviously if / be a switching of 
J then J is a switching of I. One can consider B as a graph where two point are connected if 
one is switching of the other one. For a subset H of B, we denote by {H)q the set containing 
H and all / a B so that there exists some finite path between some element of H and I. 
In fact looking to B in this way, {H)q would be the union of all connected components of B 
which have nonempty intersection with H. Let w : B ^ B he the function that for every 
I, switches the values of 1(0) and 1(1) to each other. Obviously w is a continuous function. 
We call a subset of B SW-closed if it is closed under the action of shift and the function w. 
Also we dehne the SW-closure of a set Lf C to be the minimal SW-closed set containing 
H. We denote the SW-closure of a set H by (H). One can see that {H) is the closure of 
{H)q under the shift action. Note that SW-closeness implies closeness under any switching. 
This is because switching in the fc’th coordinate can be written as {w{s~^(I))) where s is 
the shift function. 

Remark 4.1 ({10}) and ({01}) are dense in B with respect to the natural metric on B. 
Definition 4.2 Let M be a model. 

1. Let a € Aut{M) and U C M. We recall the Definition 13.51 in this case and define the 
symbolic representation with respect to a and U as the following map 

: M ^ 2^ 

o —{n € Z : (T"'(a) G U}. 

2. Let 4'{x, y) be a formula, A C M, G = Aut{M/A) and U = {(/>(x, b) : b £ M}. We define 
the "L-total symbolic image of the formula 4>{x, y) on parameter set A with respect to the 
action of G to be pg,z,u{M) := \JueU Pg,z,u{M) where pg,z,u{M) := U^eG 

When A = 0 we use notation Pff,{M) and call it the "L-total symbolic image of the 
formula 4 >{x,y). 

The following proposition roughly says that for a definable set no essentially new element 
in symbolic images will be added by going to elementary extensions. 

Proposition 4.3 Let M be a model, b £ M and U = (p{M, b) be a definable set in M. Let a 
he a map from M to M and N be an elementary extension of M. Also let r be an extension 
of a to N and = (fiN, b ). Then 

1. The set is dense in 

2. If N is saturated and a and r are automorphisms of M and N respectively, then 

is egual to cl{fa,u{M)), the topological closure of in B. 

Proof [T]) Assume for contracliction thsit there exists I G \ Since 

I 0 cl{^a,U (M)), for some initial segment of /, say J = (/(—n),...,/(n)), no element of 
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contains J as initial segment. Let bi = r*(6) for each i G Z. Since r is an extension 
of a and b € M, then bi’s are in M. So M ^ * where * is the following sentence 

* :^x{(p^^~'^\x,bn) A (p^^~'^'^^\x,bn-i) A ... A 4>^^'^'>{x,b_n))- 

Since M < N and * is a sentence in the language C{M), we have iV |= *. This implies that 
there is no element in ^^jjn{N) containing J as initial segment. This contradicts with the 
existence of I. So C cl{^a,uiM)). 

ED Using part [H it is enough to show that (M)) c jjn{N). For every natural 

number j let dj be an element of M and Ij := ia,u{dj)- Assume that / G be such that Ij’s 
converge to I. Let Cj = ct®( 6) for each i We define a partial type over O^ib) as follows. 

p = G Z}. 

We recall that by and we mean -<(j) and (j) respectively. One can see that p is consistent 
with T and is a partial type. Now by Ki-saturation of N and since the parameters of p are 
in M, p is realized in N by some d G M. Since r is an automorphism, for every arbitrary fix 
i G Z we have that 

T\d) ^d£ T-\(j){M,b)) ^ (p{d,T-\b)) ^ (j){d,a-\b)) ^ (j){d,c-i) ^ I{i) = 1 

So we have that ^r,u^{d) = I- Thus I G So U the proof 

is complete. □ 

Corollary 4.4 Let M be a 'Ai-saturated model of a theory T and U = (f{M,b). For every 
a G Aut{M) the followings hold. 

1 . ^o-,c/(Af) is closed in B. 

2. For every M < N and every r G Aut{N) extending a, we have that y{N)=i^^u{M) 
where V = f){N, b). 

Proof [1]) Using partis of 14.31 and letting M = N. 

E]) Using parts [Tl and [2] of 14.31 is dense in f^Ty{N) and also is closed. Therefore 

ir,v{N) = Uu{M). □ 

Remark 4.5 If M is not Mi-saturated then might not be closed in B. For example 

let M be the countable random graph (the Rado graph), a G M, U := {x G M : x ~ a} 
be a definable set (where ~ denotes the adjacency relation in graph) and cr be a cyclic 
automorphism. Note that in this case one can look at M as the Cayley graph of (Z, +, S) for 
a suitable universal sequence S and automorphism a as the shift on Z. Using this point of 
view ^o-^{/(M) consists of the shift orbit of the sequence f,a,u{.o)- So 1 0 But since 

5 is a universal Z-sequence, ^o-,t/(M) is dense in 2^. So it is not closed. 

Push forward measures via symbolic representations 

Let M be a model, U be definable set of some instance of some formula with parameter 
from M, be a Keisler measure on S{M) and a be an automorphism. Obviously a acts on 
S{M) and U can be seen as a subset of S{M). One may consider symbolic representation with 
respect to a and U in S{M). The following statement shows that symbolic representations 
are continuous function on spaces of types. 
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Lemma 4.6 1. ^a,u is a continuous function. 

iu,u o a = S~^ o and Ca,u o a~^ = S o 

Proof [T]) For definable set U, by and we mean U and respectively. Let A = 
f,r 7 ,uiS{M)). Also let I be an arbitrary element of 2^. We show that for every r € M"*", 
is open in S{M) where Br{I) is the open ball with radius r and center I in B. 
There exists some € N such that Br{I) consists of those J € 2^ such that I{i) = J{i) for 
every —Ur ^ i ^ Ur- So we have that 

Ur 

f.~}jiBriI)) = {p & S{M) : e a\p) for every - Ur ^ i ^ Ur} = Q 

i=—nr 

But the last expression is an open set in S{M). So we are done. 

[2]) For simplicity we use the notation ^ for Let p € S{M). So 

^ o a{p) = {i : cr\a{p)) € [/} = {i - 1 : a\p) G C/} = i{p) - I = s~^ o ^{p). 

Similarly 

^ o cr~^{p) = {i : cr*(cr“^(p)) € 17} = {f + 1 : a\p) € C/} = f,{p) + 1 = s o ^(p). □ 

Let ;U be a measure on S{M). By previous lemma is a continuous function on 2^. 
Hence it is a measurable function and can push forward the measure p from S{M) on 2^. We 
denote this pushed forward measure by Note that r'^,a,u concentrates on 

The following lemma shows that if moreover p is cr-invariant, then r'fj.,a,u is s“^-invariant 
where s and are right and left shifts on 2^ respectively. Moreover if p is both cr and a~^ 
invariant then induced measure will be two sided shift-invariant. Note that shift invariant 
measures on 2^ are extensively studied in the literature. 

Remark 4.7 If p on S{M) is cj-invariant ((T“^-invariant) then on 2^ will be 

invariant (s-invariant). 

Proof We use ^ instead of fG,u and u instead of r'/^,cr,c/- Obviously, for every measurable 
A C 2^, we have that ^{A) = o ^“^(A)). Using part [2] of Remark 14.61 we have that 
= (t(^“^(A)) and ^“^(s(A)) = cj“^(^“^(A)). Now if p is (T“^-invariant one has 

v{s-\A)) = p{C\s-\A))) = p{{a{CHA)))) = p{{CHA))) = v{A). 

Similarly if p is cr-invariant one has that 

u{s{A)) = p{C\s{A))) = p{{a-\r\A)))) = p{{C\A))) = v{A). □ 

4.0.4 Independence property 

The following statement characterizes independence property in terms of symbolic images of 
formulas. 

Theorem 4.8 Let T be a theory and 4>{x, y) a formula. Then the followings are equivalent. 
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1. The formula 4>{x,y) has IP. 

2. There exists some model M of T, some instance U = (p{M, b) for some b & M and 

some automorphism a of M such that is dense in B. 

3. There exists some model M of T and some automorphism a of M sueh that for every 

n £ N, there exists some instance Un = bn) for some bn £ M such that every 

binary sequenee of lenght n appears in some element of as a subsequenee. 

f. There exists some model M of T, some instance U = <f{M,b) for some b £ M and 
some automorphism a of M such that f,a,u{^) contains a universal sequence. 

5. There exists some model M of T, some instance U = b) for some b £ M and 

some automorphism a of M such that ^u^u(M) = B. 

6 . There exists some model M of T such that P(j,{M) is dense. 

Proof ([2] =4>rT]) Let re G N be arbitrary. We show that there exists a witness for IP of length 
re. Let J = Ji,..., J 2 ^ be the sequence of length re.2” obtained by concatenation of all binary 
sequences Jfs of length re. Since is dense in B, there exists some xj £ M such that 

{i ; 1 ^ i ^ 2”, a'‘{xj) £ U} is same as J when we regard it as a binary sequence. We 
claim that the sequence (cr*(xj))j=i_...^n witnesses IP of length re. Let {/i, I 2 } be an arbitrary 
partitioning of / = {1,..., re}. There is exactly one 1 ^ t ^ 2” such that Jt{j) = 1 for j £ Ii 
and Jt{j) = 0 for j £ I 2 . So Jt corresponds to n{t — 1) + I’th up to rePth coordinates of J. 
So for each i £ I 1 + n{t — 1) we have that 4>{a^{xj), b). Also for each i £ I 2 + n{t — 1) we have 
that {xj), b). Let d = (6). Therefore we have (f{a^{xj),d) for every i £ Ii and 

^4i{a^{xj),d) for every i £ I 2 . So we have witnessed IP of length re. 

(jH =4 0|) Let XI £ M he such that I ;= f,a,u{xi) be a universal sequence. We denote 
the sequence I + n (sequence obtained from I after re shifts) by In- So for every n £ Z, 
we have = In- Hence In £ ^cr,t/(Af). So for every finite sequence of length 2re 

(re £ N), there exists some element of containing that sequence in —re’th up to re’th 

coordinates. This implies that ^^-^{/(M) is dense in B. 

(i ^CH) For every re G N, using an argument similar to that of part ([2] =4 rT} . IP is 
witnessed with length re. 

([6] =d) Let re G N be arbitrary and J be as in the argument of part ([2] =d) • By part 
[2] of the Definition [Ol we have p^(M) = UbeM UcreAut(M) where Bb = 4>(x,b) for 

every b. Since prf,{M) is dense there exists some a £ Aut(M), some b £ M and some xj £ M 
such that {i : 0 < i ^ re, a^{xj) £ Ub} = J. Now again similar to the argument of part 
(12^, {cr^(a:j),..., a^{xj)} witnesses IP with length re for (j). 

(f5]= T4)) . (f4l=T2) and (f2]= T6|) are obvious. 

(ID =4>r5l) By a theorem of Shelah (see for example Theorem 12.18 of [8]) there exists a 
formula (j)(x,y) with \y\ = 1 witnessing IP. Also by some fact (See for example Lemma 12.16 
of [8]), the formula ip defined with ip{x,y) := 4>{y,x) has IP too. By saturation, there exists 
an indiscernible sequence witnessing IP for p. Again by saturation there exists some 

automorphism of M, say cr, such a* = (T®(ao). Let I be an arbitrary binary Z-sequence. By 
IP, there exists b £ M such that for every i £ Z we have p{ai, b) if and only if i G —I. Now let 
bi = cr*(6). Then clearly we have ip{bi,aQ) if and only if p{a-i,b). By letting U = V’(Af, uq), 
we have that f,a,uib) = I. Now the proof is complete. □ 
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One sees that the equivalence of parts [T] and [6] in the above theorem shows that whether 
or not 4> has IP, is reflected in the p^{M), the Z-total symbolic image of (p. 

Now we give a characterization of NIP property in terms of Bernoulli measures and push- 
forwarded measure on B. 

Proposition 4.9 Let T be a theory and 4>{x, y) a formula. Then the followings are equiva¬ 
lent. 

1. The formula (j){x,y) has IP. 

2. There exists some model M of T, some instance U = 4>{M, b) for some b G M, some 

automorphism a of M and some a-invariant measure p on S{M) (or M) sueh that the 
push forward measure p-Bernoulli measure on B for some 0 < p < 1. 

3. For any given 0 < p < 1, there exists some model M ofT, some instance U = (p{M,b) 

for some b G M, some automorphism a of M and some a-invariant measure y on S{M) 
(or M) sueh that the push forward measure p-Bernoulli measure on 

B. 

Proof ([T] =4r3]) Assume that 0 < p < 1 is given and i?!)(x, y) has IP. Let M be a saturated 
enough model of T and let B := {ai)i^z be an indiscernible sequence witnessing IP for </>. 
Because of saturation, there exists some a G Aut{M) such that cr*(ao) = a* for every i. By 
Remark 12.21 there exists some p-normal number u. Let J be the Z-sequence associated to 
u (defined in the Definition 12.31) . Since B witnesses IP, there exists some b G M such that 
(j){ai,b) i G J. Let U = c/){M,b). So a* = cT*(ao) G for every 1 ^ ^ |J|. Let F 

be an ultrafilter extending the Prechet filter and let pj”” be the limit frequency measure on 
Def{M) with respect to B defined in the Definition 13.61 So for every definable set D, we 
have yIp°‘°{D) = dnsjr{f^„^£){ao)). As explained in the Remark 12.131 this measure could be 
seen as a measure on S{M). Now we claim that the pushed forward measure u induced by 
on 2^ via the map is a p-Bernoulli measure. For showing that, it is enough to show 
that the measures of cylindrical sets are as what the p-Bernoulli measure gives to these sets. 
Let W be an arbitrary finite binary sequence and a and /3 be number of appearance of I’s 
and O’s in W respectively. By using of notations we have defined earlier we have that 

u{[W]) = y^/°{{x G M : G [ID]}) = y^/°{{x G M : F{x) G 1 ^ j ^ |ID|}) 

= p 7°( f| a-^{U^^^^)) = dnsr{{iGl.-.a\ao)G f| a-^{U^^^^)]) 

= dnsjr{ n 'L-.a\ao)Ga-\U^^^^)]) = dnsr{ fj {i GZ ■. {ao) 

= dnsjr{ Pi {C^uwu){ao) - j)) = dnsjr{ Q ((J - 

Now using Remark 13.41 we have that 

u{[W]) = dnsA{W,J)). 
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But since J is the sequence associated to a p-normal number we have that 


dnsr{{W, J)) = p°‘{I - pf. 


So claim is proved and [3] holds. 

(P=>r 2 ]l is obvious. 

(la^CI]) Assume that [ 2 ] holds. So there exists some 0 < p < 1 and some p-Bernoulli 
measure which is pushed forward from some measure p on M. For every i 7 ^ 0 we have 
that 

p{U n a\U)) = p^{{I : 1(1) = 1, 1{i) = 1}) = p\ 


So 


p{UAa\U)) = p{U) + p{a\U)) - 2p{U n a\U)) ^ 2{p - p^). 


Now by using the Theorem 12.141 the formula 4>{x,y) has IP. □ 


4.0.5 Order property 

The following statement characterizes order property in terms of symbolic images of formulas. 


Proposition 4.10 Let T he a theory and (j)(x,y) be a formula. Then the followings are 
equivalent. 

1. The formula (j){x,y) has order property. 

2. There exists some model M of T, some instance U = 4>{M, b) for some b G M, some 
automorphism a of M and some a G M such that f,a,u{ci) = 10. 

3. Same as\^ with additional property that a G B 4 . 

4 . There exists some model M ofT, some instance U = (j)(M,b) for some b G M, some 
automorphism a of M such that for every n G N, there exists some element in 

which contains (i 0 )„ as a subsequence. 

5. There exists some model M of T and some automorphism a of M such that for every 

n G N, there exists some instance Un = 4>{M, bn) for some bn G M, such that there 
exists some element in which contains (10)„ as a subsequence. 

6. There exists some model M of T, some instance U = 4>{M, b) for some b G M, some 

automorphism a of M such that the topological closure of contains 10. 

7. There exists some model M of T such that 10 G P(i,{M). 

Proof (fn^Oll Using the Lemma [2.7l there exists some model M, some indiscernible sequence 
I = {o.i)i£Z and a sequence J = {bj)i^z in M such that (j){ai,bj) 4^ i ^ j for every i,j G Z. 
We may assume that M is saturated enough. By indiscerniblity of I, there exists some 
automorphism cr of M such that cJ*(ao) = a* for every i G Z. So letting U = 4>{M,bo) we 
have that 

iu,u{ao) = {i G Z,(l){ai,bo)} = 10. 
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(H ^CH) For every n € N, we find a witness for order property with length n. By 
assumption and also the fact that is shift invariant, there exists some a G M such 

that contains (10)^ in the coordinates —n up to n. So we have that {—n ^ i ^ n : 

cr^{a) G (l>{M,b)} = (10)^. Let a* = cr*(a) and bi = (T*(6) for every i G Z. Then for every 
0 ^ i, j ^ n we have that (p{ai, bj) (p{ai-j,b) 4^ i ^ j. So (p has OP of length n. 

By partElof the Definition [42] we have Pcp{M) = [Jegm Ua£Aut{M) where 

Uh = 4>{x,b) for every b. So there exists some a G Aut{M), some b ^ M and some a € M 
such that {i G Z, (T*(a) G (j){M,b)} = lO. Let ai = (T*(a) and bi = (T*(6) for every z G Z. So 
we have that 4>{ai, bj) 44- (j){ai-j, b) if and only if i ^ j for every i,j G Z. 

(f2]=> i~3]l By Ramsey theorem and compactness. Also (f5]=> i~6]l is by compactness. 

(I2]=>Q|) and ([2]=>[T|) are obvious. 

P=> r6]) . (131 ^[21) and P^ TSl) are easy. □ 

Note that assuming M is Mo-saturated, then by Proposition 14.101 and the Corollary 14.41 
(p has OP if and only if for some instance U oi 4> and some automorphism u of M we have 
that 10 G ^o-,[/(Af). One sees that the equivalence of [1] and [7| in the Proposition 14.101 shows 
that whether or not (p has OP is reflected in the Z-total symbolic image of (p. 

4.0.6 Strict order property 

In this part we characterize strict order property in terms of symbolic images of formulas. 
Let 0 be subset of B consisting of shift orbit of 10. 

Proposition 4.11 Let T be a theory and (p{x,y) be a formula. Then the followings are 
equivalent. 

1. The formula (p{x,y) has strict order property. 

2. There exists some model M of T, some instance U = (p{M, b) for some b ^ M and 
some automorphism a of M such that U ^ (x{U). 

3. There exists some model M of T, some instance U = (p{M, b) for some b £ M and 

some automorphism a of M such that consists of Q and possibly 0 and 1. 

4- Same as0 with additional property that a G Wb- 

Proof ([Tj ^Oj) By using the Lemma 12.111 there exists some model M of T and some 
indiscernible sequence I = {bi)i^z in M such that (p{M, bi) ^ 4>{M, &j+i) for every i G Z. We 
may assume that M is saturated enough. By saturation and indiscerniblity of I = {bi)i£z, 
there exists some automorphism cr of M such that cr^ibo) = bi for every z G Z. Let U = 
(p{M, bo). So we have that U ^ (^{U). 

([2] =401) Since U ^ (x{U), we have a^{U) ^ a^~^^{U) for every z G Z. So (p{M,bi) ^ 
(p{M, bi+i) for every i £ Z. Hence cp has SOP. 

([2] =4 r3|) Since U ^ (x{U) we have a~^{U) ^ U. So there is no appearance of 01 as a 
subsequence in f,a,uio-) for every a G M. So f.a,u{M) consists of 0 and possibly 0 and 1. 

(I3|=C2]) We show that U ^ (x{U). First we show that Lf C a{U). Assume for contradiction 
that a £ U \ cr{U). Let I = Co-,[/(a). So /(—I) = 0 and 1(0) = 1. Hence I contains 01 as a 
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subsequence which is a contradiction. Therefore U C a{U). Since contains 0, there 

is some a ^ M such that = 10. So a £ U but a{a) 0 U implying a 0 a~^{U). Hence 

a~^{U) ^ U. Now we have U ^ o-(C/). □ 

Now we give a characterization for NSOP theories in terms of symbolic representation 
and SW-closeness. 

Proposition 4.12 A theory T is NSOP if and only if for every (some) 'till-saturated model 
M ofT, every formula 4>{x,y), every instance U = (p{M,b) of cf with parameter b £ M and 
every a £ W^,, the symbolic image f,cr,u{AI) is SW-closed in B. 

Proof Assume for contradiction that is not SW-closed where U = 4>{M,b) is 

some instance of some formula in some saturated model M and a £ H4. So, since ^o-,c/ (M) 
is shift-invariant, there are I,J £ B such that J = w{I) and I £ while J 0 f,a,u{AI). 

Without lose of generality we may assume that /(O) = 1, /(I) = 0, J(0) = 0 and J(l) = 1. Let 
A := {'i/ij, i G Z} and B := {xi, i € Z} where V’i = (T“*(6)) and Xi = 

for every f G Z. One sees that V’i = Xi for every z 7^ 0,1 and so A and B are different only 

for z = 0,1. Also xfo = ->xi and ifi = -■Xo- Since I £ A is satisfiable by any a £ M 

with I = But since J 0 and M is saturated, B is not satisfiable and is 

inconsistent. So there exists some n G N such that for Z := nig[-n n]\{o 1} ^ ^ b) 

and Y := (f>{M,a~^{b)), we have that X n H Z ^ @ while 11 Y n Z = 0. Therefore 

Y n Z ^ X n Z. Since a £ Wb, the u-orbit of b is an indiscernible sequence. Hence there 
exists some automorphism r such that Z = t{Z) and X = t(Y). Let R = Y (1 Z. So R 
is a definable set with the property that R ^ t{R). We may assume that R is defined by 
some instance of some formula (. Now by part [2] of Proposition 14.111 ( has SOP which is a 
contradiction with our assumption that T is NSOP. 

<i=) Assume for contradiction that some formula 4>{x,y) has SOP. So by part 0] of Propo¬ 
sition |4TT1 there exists some model M of T, some instance U = 4>{M, b) for some b £ M and 
some automorphism r G Wb such that consists of 0 and possibly 0 and 1. Let I be 

the sequence with /(z) = 1 for z < 0 and z = 1, and I{i) = 0 for z = 0 and z > 1. Now I is 
a switching of 10 while I is not in This contradicts with SW-closeness of ^T-,c/(Af). 

□ 

4.0.7 Shelah’s theorem: OP if and only if IP or SOP 

In this part we conclude Shelah’s characterization of OP in term of IP and SOP using the 
language and materials presented earlier. Note that by comparing part [3] of Proposition 14.111 
and part [6] of Proposition 14.101 one easily concludes that if (f has SOP then it has OP. 

Theorem 4.13 Let T be a theory and (f>{x,y) be a formula with OP. Then either (j) has IP 
or there exists some formula with SOP. 

Proof Assume that every formula of T is NSOP. Since 4>{x, y) has OP, by part part [3] of 
Proposition 14.101 there exists some b £ M and some a £ Wb such that lO G f,a,u{AI) where 
U = (l){M,b). Since T has NSOP, by Proposition 14.121 H := is SW-closed. So 

({10}) C {H) = H. Hence by Remark I4.lt H is dense in B with the natural metric. Now by 
theorem 14.81 cf has IP. □ 
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